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Technical Field 

[0001] The present invention relates in general to project evaluation tools, and more 
particularly, to methods, systems and program products employing a computer- 
implemented evaluation tool for assessing a product development project, such as an 
information technology application development project or hardware development 
project. 

Background of the Invention 

[0002] Manual reviews of software application development projects are routinely 
performed to determine whether a project is on schedule, on budget and will deliver the 
promised function at the appropriate level of quality. Over the years, a number of 
researchers have shown that the failure rate of software development projects is 
exceptionally high and those studies also provide high level guidance on the typical or 
common root causes. The general categories of failure are known and are documented in 
many publications, including, for example, two publications authored by Steve 
McConnell entitled Code Complete , Microsoft Press (1993) and Rapid Development , 
Microsoft Press (1996), both of which are hereby incorporated herein by reference in 
their entirety. What is not as well understood is how to ascertain that a particular area of 
failure is present on a software development project. In addition, existing references do 
not include a logical approach to assess project management processes and their impact 
on the overall success or failure of a project. 

[0003] A typical software project reviewer manually focuses on the project 
management system and/or dives deep into the technical aspects of the project. By 
operating purely at the project management system level, the reviewer may miss an 
underlying cause of corruption in the best practices by not applying a disciplined, logical 
approach to assessing the evidence that is generated by the effective use of project 
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management best practices, i.e., by not assessing the artifacts that are produced. For 
example, a reviewer may look to determine that an issues management system is in place, 
but fail to check to determine if an issues log has the correct and adequate data to allow 

the issues management system to work. At the other end of the spectrum, i.e., at the 
technical end, a reviewer may focus on the technology or product dimensions of software 
delivery and fail to assess or understand the people and process impact on the ability of 
the team to deliver the required application. 

[0004] By not having a logical, holistic, and end-to-end approach with consistent 
scoring and focused questions to identify areas of failure, the traditional review boils 
down to the application of the experience of the reviewer to the situation. If the reviewer 
has limited experience, then the validity of the project assessment suffers. 

[0005] Thus, provided herein is a true end-to-end assessment approach which 
removes the product development project assessment from simply the reviewer's 
experience. 

Summary of the Invention 

[0006] The shortcomings of the prior art are overcome and additional advantages are 
provided through the provision of a method of assessing a product development project. 
The method includes identifying multiple possible root causes of trouble for a product 
development project and identifying question sets for the multiple possible root causes of 
trouble. The method fiirther includes providing a computer-implemented tool to evaluate 
answers to the question sets and provide guidance regarding possible existence of one or 
more root causes of trouble for the product development project from the identified 
multiple possible root causes of trouble. 

[0007] Further aspects of the method include evaluating project management 
processes employed for the product development project by comparison thereof to 
identified, standard project management processes. The computer-implemented tool 



END920030113US1 



-2- 



provides guidance regarding effectiveness of implementation of the project management 
processes employed for the product development project. 

[0008] Systems and computer program products corresponding to the above- 
summarized methods are also described and claimed herein. 

[0009] Additional features and advantages are realized through the techniques of the 
present invention. Other embodiments and aspects of the invention are described in 
detail herein and are considered a part of the claimed invention. 

Brief Description of the Drawines 

[0010] The subject matter which is regarded as the invention is particularly pointed 
out and distinctly claimed in the claims at the conclusion of the specification. The 
foregoing and other objects, features, and advantages of the invention are apparent fi'om 
the following detailed description taken in conjunction with the accompanying drawings 
in which: 

[0011] FIG. 1 is a block diagram of one embodiment of a process for assessing a 
product development project, in accordance with an aspect of the present invention; 

[0012] FIG. 2 is a block diagram of one embodiment of the project interview process 
of FIG. 1, in accordance with an aspect of the present invention; 

[0013] FIG. 2A is a sample root cause of trouble and associated question set for 
identifying the root cause of trouble, in accordance with an aspect of the present 
invention; 

[0014] FIG. 3 is a block diagram of one embodiment of the project document review 
process of FIG. 1, in accordance with an aspect of the present invention; 

[0015] FIGS. 3A, 3A* & 3A" are a sample work product assessment worksheet for 
evaluating an issue log, in accordance with an aspect of the present invention; 
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[0016] FIGS. 3B & 3B' are a sample worksheet summary produced by the work 
product assessment, in accordance with an aspect of the present invention; 

[0017] FIG. 3C is a sample work product assessment chart derived from the work 
product assessment, which is partially summarized in the worksheet simmiary of FIGS. 
3B & 3B', in accordance with an aspect of the present invention; 

[0018] FIG. 4 is a block diagram of one embodiment of the project execution analysis 
process of FIG. 1, in accordance with an aspect of the present invention; 

[0019] FIGS. 4A and 4A' are a sample execution assessment table and findings chart, 
respectively, in accordance with an aspect of the present invention; 

[0020] FIG. 4B is a partial sample strength of evidence scoring activity worksheet 
(A), which is a view of the root causes, in accordance with an aspect of the present 
invention; 

[0021] FIG. 4C is a partial sample execution worksheet (B) scoring, which again is a 
view of the root causes and shows the examined work products and the assessment of the 
work products averaged together, in accordance with an aspect of the present invention; 

[0022] FIG. 5 is a block diagram of one embodiment of the work processes analysis 
process of FIG. 1, showing inputs for developing the project assessment report, in 
accordance with an aspect of the present invention; 

[0023] FIG. 5 A is a sample process assessment chart showing one of the tables and 
graphs that can be generated for the various project management domains in the work 
processes analysis process, in accordance with an aspect of the present invention; 

[0024] FIG. 5B is a sample execution worksheet (B) which is an input to the activity 
worksheet (A) used in the work processes analysis process, wherein worksheet (B) maps 
the work products against the domains of IBM's World Wide Project Management 
Method (WWPMM), in accordance with an aspect of the present invention; 
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[0025] FIG. 5C is a sample activity worksheet (A) which is the input to the PMBOK 
process worksheet used in the work processes analysis process, and which shows the 
WWPMM domains and considers the work products that would be produced as part of 
the effective implementation of the process that the domain represents, in accordance 
with an aspect of the present invention; 

[0026] FIG. 5D is a sample of the process worksheet which stores the data used in the 
process assessment chart, which is the output of the work processes analysis process, in 
accordance with an aspect of the present invention; and 

[0027] FIG. 6 is an expansion of the report development process of FIG. 1, showing 
the inputs from FIGS. 2, 4 & 5, in accordance with an aspect of the present invention. 

Best Mode for CarryiPH Out the Invention 

[0028] The project assessment tool and process disclosed herein allow an evaluator to 
quickly identify and prioritize the existence of one or more common root causes for 
trouble on an information technology software or hardware development project, and 
relate these to the adequacy of the implementation of project management best practices. 
The tool and the process to apply the tool to an assessment, establish discipline in 
organizing the review team, identifying the project participants to interview, and 
generating a focused question set. Answers to the question sets are scored and allow the 
tool to identify the significance of the evidence regarding the existence of a particular 
root cause of trouble. The questions to ask to determine whether a particular root cause 
exists and to whom to ask those questions form a core that the scoring mechanism is built 
around. 

[0029] In one aspect, the assessment process requires that the project management 
system also be evaluated. Using the standard project process structure advocated by the 
Project Management Institute as widely recognized best practices, the assessment tool 
and process provides the reviewer the means to score the application of best practices to 
the particular project. The tool and process recognize that individual project management 
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artifacts should be considered to conclude whether a particular process has been 
effectively implemented. The tool/process includes an automated scoring mechanism 
that rolls up the quality assessment of the artifacts into the project management process 
area, supporting the reviewer's ability to judge the quality of implementation of each 
project management best practice area. The evaluation criteria to judge the fitness for 
purpose of a particular project management artifact and the linkage of that evaluation 
with the best practice area to allow assessment of the project management discipline 
forms a further aspect of the present invention. 

[0030] The combination of the two views - the root cause view computed based on 
scored questions and the process view computed based on the artifact ratings and the 
process scoring - provide a project assessor prioritized insight into what is wrong with a 
project and which processes contribute most to a failure. This allows the reviewer to 
quickly develop recommendations for corrective action, if needed. 

[0031] Scoring is thus determined based upon a computerized workbook tool scoring 
and the project manager reviewer scoring. The work product score is calculated by a 
computer implemented workbook tool. This computerized score rolls over into the 
process scoring. All work product scores that apply to a process are averaged and shown 
to the project manager reviewer as evidence. The workbook tool presents the reviewer 
with scoring guidelines for each process on an activity worksheet. The project manager 
reviewer considers that information, as well as the computed work product score, and 
manually scores the process. All scores are then used to assess the strength of evidence 
regarding the root causes. The project manager reviewer enters a score, based on the 
interview results and the work product and process scores, against each root cause (using 
the questions provided in the workbook tool (discussed further below)) in the area of 
strength of evidence, impact in terms of cost, time and requirements. 

[0032] The Project Assessment Workbook Tool is a computer-implemented 
diagnostic tool for use by a Project Manager Reviewer (PM Reviewer) in three phases of 
a project assessment: 
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• Information gathering / interviews 

• Analysis of documentation / data gathered 

• Preparation of assessment findings / report generation. 

[0033] During the information gathering phase, the Project Manager Reviewer uses 
the focused diagnostic tool, i.e., the Project Assessment Workbook Tool, to ask specific, 
targeted questions to personnel in key project roles who interact with the members on the 
assessed project. The questions are organized to look for symptoms of the common root 
causes of failure for, for example, 61 typical potential trouble areas. Each root cause has 
a question set associated with it, and is identified with specific project roles to focus the 
questioning on the individuals who are likely to see the symptoms emerging. This allows 
the PM Reviewer to quickly diagnose potential problem areas. The PM Reviewer 
conducts interviews with project personnel during the interview phase of the engagement. 

[0034] During analysis, for each potential problem area, the PM Reviewer works 
backwards. Problem areas are mapped to the common project management processes 
established by the Project Management Institute (PMI) (see "A Guide to the Project 
Management Body of Knowledge" (PMBOK® Guide), An American National Standard, 
ANSLTMI 99>00 1 -2000, PMI (2000 Edition), the entirety of which is hereby 
incorporated herein by reference) : 

• Scope Management 

• Time Management 

• Cost Management 

• Quality Management 

• Human Resources Management 

• Communications Management 

• Risk Management 

• Procurement Management 

• Integration Management 
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[0035] The PM Reviewer conducts further analysis, based on the possible failure to 
properly implement these best practice processes, of the trouble symptoms. Once the PM 
Reviewer identifies process failures, they trace these back to the supporting project 
management documentation and conduct additional analysis to determine what content is 
missing, is the document preparation cycle adequate, are the right project stakeholders 
involved, and answer other fundamental execution questions. 

[0036] Root cause analysis of troubled projects (such as delineated in the above- 
incorporated publications by Steve McConnell in "Code Complete", Microsoft Press 
(1993) and "Rapid Development", Microsoft Press (1996)), together with the World 
Wide Project Management Method product available from International Business 
Machines Corporation, are embodied (in one embodiment) in the toolset, as explained 
further below. One of the first steps in the review is to quickly map the project process 
and documentation universe to the Work Products to exploit this attribute. Most project 
management methods are built on the PMI processes listed above and leverage a finite set 
of project management docxmients - it becomes a fairly quick exercise to discover what 
these documents are called by the project being reviewed. It also allows the PM 
Reviewer to identify any basic gaps between the project management method in use and 
the generally accepted project management methods. 

[0037] This approach identifies and highlights project characteristics that represent 
key success/failure factors for the engagement. These are leveraged to become the basis 
of a report which graphically shows the areas of strength/weakness in a project's 
processes and work products. 

Project Assessment Workbook Tool 

[0038] FIG. 1 shows a Project Assessment Workbook Tool 104, which, in one 
example, can be an Excel-based spreadsheet with multiple inter-related worksheets 
running on a personal computer. The underlying constructs for the Project Assessment 
Workbook Tool 104 can be, for example, the fifty or so Work Products and definitions 
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from the above-referenced IBM World Wide Project Management Method (WWPMM) 
product 101, a list of root causes of troubled projects 102 derived from the above- 
incorporated Steve McConnell texts 137, 138, and a list of management processes as 
defined by the Project Management Institute in the above-incorporated PMBOK 103 
material. The WWPMM product available from International Business Machines 
Corporation (IBM) is summarized below for completeness. Also, the examples provided 
hereinbelow assume that the product development project to undergo assessment 
comprises a software development project. 

[0039] The project management method employed by WWPMM is based on the 
Project Management Institute's internationally recognized framework. 

[0040] The IBM World Wide Project Management Method (WWPMM) traces its 
heritage back to the basic principles of the PMBOK and adds focused extensions for 
applicability to Information Technology (IT) appHcations. In addition to recognizing the 
best practices established in the PMBOK, the developers of WWPMM employed other 
established methods and standards like IEEE, ISO 10006, and the Software Engineering 
Institute for guidance and direction. The resulting method, deployed for corporate wide 
application and use by IBM, represents the result of this research filtered through the 
successfiil delivery of thousands of IT projects. 

[0041] WWPMM organizes the project management (PM) approach and method 
around domains and extends PMI by creating work patterns and work products. The 
architectural structure of the PMI framework and WWPMM are essentially the same with 
the PMI knowledge areas equating to WWPMM domains and PMI processes to 
WWPMM sub-domains and processes. In WWPMM, there are 13 domains versus the 
above-noted 9 knowledge areas of PMI and the 37 PMI processes map to 51 WWPMM 
sub-domains supported by 150 more focused processes. To meet the challenges of the IT 
application area, the extensions represented by the difference in numbers were added. 
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[0042] Work patterns are a series of steps designed to meet particular project 
management goals or in response to particular project management situations. In effect, 
work patters link the best practice processes into a series of useful steps that are event 
based (like a use case). These procedures provide step-by-step guidance to the PM to 
drive consistent execution to minimize risk. While they are designed to be usable on 
their own, the PM work pattems provide references to processes in the domains to enable 
easy access to more details. 

[0043] Most of the PM work pattems can be activated at any time. For example, 
project management may have to release a subcontractor before starting another, or 
release design staff before beginning with developers. 

[0044] Work products are the verifiable outcomes that are used to manage projects. 
The domains provide the high level grouping to organize the work pattems, and the work 
pattems produce work products. 

[0045] There are four PMI knowledge areas that map directly to WWPMM domains: 

PMI Knowledge Area WWPMM Domain 

Project Quality Management Quality Management 

Project Human Resource Management Human Resource Management 

Project Risk Management Risk Management 

Project Procurement Management Procurement Management 

[0046] Three of the domains employed in WWPMM fill gaps in the PMI knowledge 
areas: 

• Sponsor Agreement Management: The notion of an agreement, contract, or 
document of understanding between a sponsoring organization and a delivery 
organization is only touched on in the PMI fi*amework. WWPMM focuses on this 
important area of project management to ensure that stakeholder commitment is 
strong and roles and responsibilities are well understood. 

• Event Management: This domain is a new area added by WWPMM to extend the 
discipline associated with issue and action management into a broader context. 
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Event Management is the steps and procedxires associated with handUng the 
planned and unplanned events that occur in the project lifecycle. 

• Technical Environment Management: Given the highly technical nature of most 
IT projects, additional discussion, processes, and procedures around the 
management of the project technical environment are employed. 



[0047] WWPMM restructured the integration and scope management PMI 
knowledge areas to better fit the applied concept of work products and work pattems and 
to better organize the planning and defining stages of the project. 



Project Integration Management 


Maps into WWPMM Domain(s) 


Plan development 


Work pattems 


Plan execution 


Work pattems 


Overall change control 


Change management 




Project Scope Management 


Maps into WWPMM Domain(s) 


Initiation 


Project definition 


Scope planning 


Project definition 
Deliverables management 


Scope definition 


Work plan management 


Scope verification 


Deliverables management 


Scope change control 


Change management 
Deliverables management 


[0048] PMFs Project Time Management, Cost Management, and Communication 


Management were restructured to separate work management and reporting as shown 


below. 




Project Time Management 


Maps into WWPMM Domain(s) 


Activity definition 


Work plan management 


Activity sequencing 


Work plan management 


Activity duration estimation 


Work plan management 


Schedule development 


Work plan management 


Schedule control 


Work plan management 
Tracking and control 
Change management 
Event management 
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Project Cost Management 


Maps into WWPMM Domams(s) 


Resource planning 


Human resource management 


Cost estimating 


Work plan management 
Tracking and control 


Cost budgeting 


Work plan management 


Cost control 


Tracking and control 
Change management 




Project Communication Management 


Maps into WWPMM Domain(s) 


Communication planning 


Communications management 


Information distribution 


Communications management 


Performance reporting 


Communications management 


Administrative closure 


Quality management 



[0049] Core to WWPMM is the notion of a project management system. The project 
management system is the way in which a particular project is managed. It is 
documented as a collection of plans and procedures that direct all project management 
activity, and records that provide evidence of their implementation. WWPMM includes a 
set of plans, procedures, and record templates that may be quickly and easily tailored to 
meet the needs of each individual project or client. Note that the management system of 
a project may include multiple management systems (such as the quality management 
system from ISO 9000:2000). Specifically for WWPMM, the PM System includes: 

• The plans describing the work to be performed and how the project will operate 

• The procedures that allow tasks to be performed in a systematic and visible 
manner 

• The records that the PM uses to control status and events 

• The project management activities that are used to plan, control and react to day 
to day situations 

• The project management resources and tools available to support the delivery of 
the project. 

[0050] Continuing with FIG. 1, the above-discussed WWPMM materials 101, the list 
of conmion root causes of trouble for software development projects 102, and the PMI 
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PMBOK materials 103 can be employed (in one example) by one of ordinary skill in the 
art to create the Project Assessment Workbook Tool 104 described herein. Tool 104 
provides a disciplined approach to assessing a product development project. The actual 
question sets for root causes of trouble and product management processes evaluation, as 
well as work product evaluation may vary depending upon the particular product 
development project under assessment. The above-described materials provide a basis 
for one of ordinary skill in the art to implement a product assessment tool as described 
herein. 

[0051] When in operation, the product assessment tool 104 receives input from a 
project interview process 105, a project document review process 106, a project 
execution analysis process 107, and a work processes analysis process 108. A Project 
Management (PM) Reviewer 110 interfaces with project personnel 111 during the project 
interview process, and extracts information from project documents 112 during the 
project document review process 106. The PM reviewer also provides input during the 
project execution analysis process and the work processes analysis process. Output from 
the computer-implemented project assessment tool 104 are one or more reports provided 
during a report development process 109. If desired, the project assessment tool can be 
customizable by the PM reviewer to ascertain one or more specific reports to quickly 
evaluate one or more aspects of the product development project. 

Project Interview Process 

[0052] As shown in FIG. 2, the PM reviewer 110 and the project personnel 111 are 
the actors in the project interviewer process 105. The PM Reviewer 1 10 uses the 
Interview List 114 documented in the tool, which itemizes the personnel roles which 
should be interviewed in the project assessment. For an IT application development 
project, the interview list can comprise a plurality of roles commonly associated with the 
software project, such as Lead Data Architect, Lead Business Analyst, Executive 
Sponsor, etc. 
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[0053] An Execution Worksheet (A) 1 13 is a worksheet with specific question sets 
129 (see FIG. 2 A) for an area of review. The execution worksheet (A) 113 contains 
question sets which provide guidance on existence of particular root causes of trouble for 
the product development project. The questions can be grouped under four headings: 

• People/Resources 

• Process/Management Discipline 

• Product/ Customer Expectations 

• Information Technology Management 

[0054] An example of the type of questions is shown in sample questions set 129 in 
FIG. 2 A. These show a few of the questions that relate to People/Resources, and in this 
example, relate to a specific root cause of trouble, i.e., "Difficult to Acquire 
Skilled/Trained Resources for the Project". 

[0055] The focused questions in the Execution Worksheet (A) 113 preclude the need 
to interview multiples of people in the same role. Each of the questions is to be answered 
by specific roles in the Interview List 114. These roles are in columnar format on the 
worksheet. There is an indicator which shows the PM Reviewer that a question is to be 
asked of a specific role. This indicator is replaced during the interview session by codes 
indicating the quaUty of the response, i.e. "generic", "could not provide an answer", or 
"provided a good specific answer". The answer is placed in the appropriate cell in the 
Execution Worksheet (A) 113. The responses can be answered usually by a limited 
amount of detail. At the close of the interview sessions the PM Reviewer scores the 
responses for impact to the project overall, impact to schedule and impact to project cost 
on a scale, for example, of 0 to -6 indicating the impact. The Execution Worksheet is 
completed in the Project Execution Analysis Process 108. 
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Project Document Review Process 



[0056] The questions asked in the Project Interview Process are validated or negated 
by the absence/presence of related data appearing in the artifacts of the project, known as 
Work Products. As shown in FIG. 3, the PM Reviewer 1 10 reviews the project 
management documents 112 that can be used on a project, as documented in WWPMM 
101, and checks that the required data is present, current and appropriate. Basic 
documents would include work products such as Delivery Control Documentation, 
Project Definition Report, Financial Plan, etc. 

[0057] Each document is scored against the appropriate Work Product Review Score 
sheet 116 which also indicates which fields are required. As shown in FIGS. 3 A, 3 A & 
3A'*, there is a column with a short description of the data that is required to assist the PM 
Reviewer 1 10 in making a judgment when assessing the field. The field is marked Y if 
the data is shown in the document being reviewed. There is space for the field name used 
in the document for tracking purposes and a space for any comments. The worksheet 
counts the number of Y responses and scores it against the total number of required 
fields. The scores go fi-om 0 to 10 depending on the percentage of required fields present 
in the document (see FIG. 3A"). 

[0058] The PM Reviewer then scores the document for Data Currency, Data 
Frequency, Data Quality and Existence. A scoring algorithm is created to generate a final 
score from 0 to 5, with 0 indicating that the document containing the required data does 
not appear to exist on this project to 5 indicating documents appear to contain appropriate 
required data. The scoring algorithm for the worksheet can be readily created by an 
experienced project management reviewer for a given product development project. 

[0059] The Work Product Review Scoresheet 1 16 contains, where appropriate, 
information on why the document is required on a project, and the impact of not having 
the document to the project. Also, the Work Product Review Scoresheet 116 contains, 
where appropriate, validation and verification criteria; cross-checks with other Work 
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Product documents; the Process Management Group to which the document relates; and 
any other useful notes. As noted, an example of a completed Work Product Review 
Scoresheet for Issue Documentation is shown in FIGS. 3A, 3A* & 3A". 



[0060] The WP Worksheet Summary 121, a sample of which is shown in FIGS. 3B & 
3B', provides information on each of the Work Products reviewed. 

[0061] The Worksheet Summary 121 sets out for each Work Product 

• The ED relating back to the Worksheet tab 

• The Work Product WWPMM name 

• The PMI Project Management Domain 

• A description of the Work Product 

• The purpose of the Work Product 

• If the document is required on the project 

• The assessment score which is populated automatically from the Work Product 
Review Scoresheet 116. 



[0062] The Work Product Assessment 115 captures and organizes the data originally 
collected in the 50+ Work Product Worksheets 116, displaying the results in both tables 
and graphs, and organizing the Work Products by PMI domain. 

[0063] The scores from WP Worksheet Summary 121, populate a set of pre- 
formatted charts in the Work Product Assessment worksheet 115. The charts show the 
documents that are appropriate to a specific PMI domain - such as Project Scope 
Management Domain, and show graphically the scoring of each document in that domain 
and also if it is a required document. 

[0064] A sample of a Project Scope Management Domain Work Product is shown in 
FIG 3C. 
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Project Execution Analysis Process 



[0065] Referring to FIGS. 4, 4A, 4B & 4C, the Execution Worksheet (A) 1 13 
includes areas to document the interview progress and high-level responses (see FIG. 
4B). 

[0066] In the Project Execution Analysis Process 107, the PM Reviewer 110 
evaluates and validates the responses in Execution Worksheet (A) 113 against the 
evidence of the documentation that was developed in the Project Document Review 
Process 106 (see FIG. 3). As shown in FIG. 4B, the Execution Worksheet (A) has a 
column headed "Examined Work Products" setting out the Work Products that validate or 
mitigate the interview responses. A sample of the Strength of Evidence Scoring is also 
shown in FIG. 4B. 

[0067] The Execution Worksheet (B) 119 provides a linkage between the Issues and 
the dependent Work Products. 

[0068] The evidence scoring from Execution Worksheet (A) 113 also populates the 
Execution Worksheet (B) 119 (see FIG. 4C). This worksheet maps the evidence score to 
the appropriate Interview Question Topic and also shows an average of the scores from 
the WP Worksheet Summary 115 documents relevant to the question. These results 
should be reviewed for any anomalies between evidence and WP Worksheet Summary 
115 results. Any anomalies should be investigated and resolved before going ftirther with 
the processes relating to the Project Assessment Workbook. 

[0069] The Execution Assessment 118 (see FIGS. 4, 4 A, & 4 A') findings capture and 
organize the data collected in the Execution Worksheet (A), displaying the results in both 
tables and graphs. Findings highlighted indicate issues where strong evidence exists that 
they are causing a significant impact on the project. 

[0070] The scoring for evidence and impact in the Execution Worksheet (A) 113 
populate the charts in the Execution Assessment (see FIG. 4A*). The Execution 
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Assessment chart shows graphically on a two by two matrix the clustering of issues with 
the issues having he highest impact and validated by evidence in the top right matrix. 
The relevant issues are highlighted in the accompanying question set. 

[0071] A sample of the People/Resources Issue set and graph is shown in Execution 
Assessment Findings of FIGS. 4 A & 4 A'. 

Work Processes Analysis Process 

[0072] Referring to FIGS. 5-5D, WWPMM Activity Worksheet (B) 120 provides the 
linkage between the WWPMM Activities and their dependent Work Products. 

[0073] The scoring from the Work Product Assessment 115 populates the WWPMM 
Activity Worksheet (B) 120. The Worksheet maps the Work Product Assessment 1 15 for 
each Work Product under the appropriate PMI Management Domain. The PMI 
Management Domains are mapped to the appropriate WWPMM Activities within the 
WWPMM Project Phases. A sample of a WWPMM Activity Worksheet (B) is shown in 
FIG. 5B. 

[0074] The WWPMM Activity Worksheet (A) 122 provides an assessment for each 
WWPMM activity based on a scale ranging from 0 to 5. The sheet also captures the 
dependencies between WWPMM activities and the PMBOK Processes and Execution 
Issues. A sample of Activity Worksheet (A) 122 is shown in FIG. 5C. 

[0075] Information for the Work Products from the WWPMM Activity Worksheet 
(B) 120 populates the WWPMM Work Product Assessment column of the WWPMM 
Activity Worksheet (A) 122. During a work processes analysis, the PM Reviewer 110 
scores the WWPMM activities set out in each row in the WWPMM Activity Assessment 
column. The PM Reviewer 110 notes the reason in the Rational for Assessment colunm. 

[0076] The PMBOK Process Worksheet 123 maps the PMI Processes to the 
WWPMM activities and then provides an assessment for each process calculated by 
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taking the average of the ratings given to its corresponding WWPMM activities. A 
sample of the PMBOK Process Worksheet 123 is shown in FIG. 5D. 



[0077] The PMBOK Process Assessment 124 Findings worksheet captures and 
organizes the data collected in the PMBOK Process Worksheet 123 displaying the resuhs 
in both tables and graphs. There is a chart and graph for each of the PMI domains noted 
in the Invention Summary. A Sample of the PMBOK Process Assessment is shown in 
FIG. 5A. 

Report Development Process 

[0078] Referring to FIG. 6, the charts and graphs that are generated in the Execution 
Assessment 118, the PMBOK Process Assessment 124 and the Work Product 
Assessment 115 can be easily cut and pasted by the PM reviewer 110 (during a Report 
Development Process 109) into a Word document to provide the Findings portion of a 
report 125. Evaluation of the graphs provides the basis for recommendations for 
remediation of any disclosed project management deficiencies, and capitalizing on the 
strengths that have been validated in the Project Assessment Process. 

[0079] To summarize, those skilled in the art will note fi-om the above description 
that provided herein is a project assessment approach which employs a Product 
Assessment Workbook Tool, which in one embodiment, comprises a spreadsheet that 
builds on the concepts of good project management set out in the World Wide Project 
Management Methodology offered by International Business Machines Corporation, as 
well as the processes promulgated by the nationally recognized Product Management 
Institute (PMI). 

[0080] The Project Assessment Workbook Tool may be an Excel-based workbook 
that examines the effectiveness of project management on a project by: 

1 . Validating the existence of project management work products and their 
quality; 
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2. 



Validating project management compliance based on the project Management 
Institute's Project Management Book of Knowledge; and 



3. Using an interview approach to look for indications of trouble based on 61 
identified root causes of possible project failure. 

[0081] Each of the above three areas has a specific section in the assessment 
workbook. The assessment workbook includes worksheets that are completed by the 
reviewer for each of the three sections, and niunerical scores are given to the answers 
received. The Project Management Reviewer inputs the answers through examination of 
documentation and interviews with project personnel. The project documentation 
required, the roles of the interviewees, and the questions to be asked are all set out 
specifically in the assessment workbook. The answers are assigned numerical scores, and 
these numerical indicators for the three areas are rolled up and come together in a 
graphical format, e.g., four separate quadrant graphs (people/resources, product/customer 
expectation, technology and process/management disciplines). 

[0082] The assessment workbook applies discipline and rigor to a process that is 
heretofore depended solely on the judgment and the project management experience of 
the interviewer. Although the assessment workbook should be used as a diagnostic tool 
by personnel versed in project management, it allows diverse projects to be assessed with 
the same criteria by different qualified personnel. Use of the assessment workbook 
allows a review team to effectively assess projects quickly and with precision based on a 
finite number of interviews (for example fifteen or less) and a specific documentation list 
(e.g., approximately fifty), irrespective of the size or dollar value of the project. 

[0083] The present invention can be included in an article of manufacture (e.g., one 
or more computer program products) having, for instance, computer usable media. The 
media has embodied therein, for instance, computer readable program code means for 
providing and facilitating the capabilities of the present invention. The article of 
manufacture can be included as a part of a computer system or sold separately. 



END920030113US1 



-20- 



[0084] Additionally, at least one program storage device readable by a machine 
embodying at least one program of instructions executable by the machine to perform the 
capabilities of the present invention can be provided. 

[0085] The flow diagrams depicted herein are just examples. There may be many 
variations to these diagrams or the steps (or operations) described therein without 
departing from the spirit of the invention. For instance, the steps may be performed in a 
differing order, or steps may be added, deleted or modified. All of these variations are 
considered a part of the claimed invention. 

[0086] Although preferred embodiments have been depicted and described in detail 
herein, it will be apparent to those skilled in the relevant art that various modifications, 
additions, substitutions and the like can be made without departing from the spirit of the 
invention and these are therefore considered to be within the scope of the invention as 
defined in the following claims. 
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